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ITERATIVE PECOPING, WITH LIKELIHOOD WEIGHTING 



Field of the invention 

The invention relates to a decoder apparatus and method of decoding 
therefor and in particular to a turbo decoder apparatus and method. 



JO Background of the Invention 

Over the last decades, the use of digital communication has increased 
drastically, and a great many digital communication systems have been 
developed and deployed. For example, the first generation analogue 
15 cellular comra unication systems have now been replaced by 2 nd generation 
digital cellular communication system, such as the Global System for 
Mobile communication (GSM). 

Currently ,j 3"* Generation cellular communication systems, Bt^jaa;t^ 
20 Universal Mobile Telecommunication SyBtem (UMTS), is being deployed. 
In UMTS, the available frequency resource must be shared between a high 
number of user equipment and sei^ces. In UMTS, the available fr^ 
spectrum is divided into one or few wide band channels having a 
bandwidth of 5 MHz. Typically, one wide band frequency channel is used 
25 for uplink in all cells and a different wide band frequency channel is used 
for downlink. In this case, separation between cells ia achieved through 
the use of spread spectrum techniques, where each cell is allocated a cell 
specific long user i 



30 In these systems, a signal to be transmitted is multiplied by the spreading 
code, which has a chip rate typically much larger than the data rate of the 
signal. Consequently, a narrowband signal is spread over the wideband 
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frequency channel. In the receiver, the received signal is multiplied by the 
same spreading code thereby causing the original narrowband signal to be 
regenerated. However, signals from other cells haying different spreading 
codes are not despread by the multiplication in the receiver, and remain 
wideband signals. The majority of the interference from these signals can 
consequently be removed by filtering of the despread narrowband signal, 
which can then be received. ' 

Separation between mobile stationB of the same cell is also achieved by use 
of spread spectrum techniques. The signal to be transmitted is multiplied 
by a user specific code. Similarly, the receiver multiplies the received 
signal with the user specific code, thereby recovering the originally 
transmitted signal without despreading sisals from any of the other 
mobile stations. Thus, the interference from all other mobile stations, 
whether in the same or if different cell, can effectively be reduced by 
filterings ' " • " ' ' ^ - • : & ■ ■ 

A consequence of the spread spectrum techniques employed is that the 
amount of the interfering signals , which fall within thd bandwidth of the 
narrowband signal, cannot be removed by filtering, and will thus reduce 
the signal to interference ratio of the received signal. Consequently, it is of 
the outmost importance that the interference between mobile stations is 
optimised in order to maximise the capacity of the system. The reduction 
of the interference from an unwanted mobile station is equal to the ratio 
between the bandwidth of tie spread signal and 

signal, equivalent to the ratio between the chip rate and the symbol rate of 
the transmitted signal. This ratio is known as the prowssing gain/The 
technique is known as Code Division Multiple Access (CDMA), and farther 
description of CDMA and spedfically of the Wideband CDMA (WCDMA) 
mode of UMTS can be found m ^C &tU]^ (editor), 
AnttiTosk^ 
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In order to com muriicate efficiently in the presence of noise and 
interference, UMTS as most other digital communication systems provide 
for error correcting coding and decoding. Hence, the information symbols 
to be transmitted are encoded by an error correcting code in the 
S transmitter, and the received signal is decoded in the receiver using a 
suitable decoder. Many different error correcting codes and decoding 
techniques are known including for example block codes and con voluUon^ 
codes. Especially, the latter are used extensively in cellular 
communication systems because they have a high performance and 
provide a high degree of robuBtnees in the adverse radio conditions 
frequently encountered in cellular communication systems. Examples of 
decoder techniques for decoding convolutional codes include Viterbi u 
decoding and Turbo decoding. 

UMTS has been developed with a view to provide high data rates and a 
high number of different services. In order to efficiently communicate high 
data rates, release 6 of the UMTS Technical Sperificatibria, in contrast to 
2»d Generation systems, ^ows for the use of higher order symbols of more 
than four constellation points for some services. As the Euclidean distance 
between different constellation points for the same symbol energy 
decreases for an increasing number of constellation 
error rate increases for higher order symbols. ITiis effec^^ 
compensated by use of i mproved error correcting coding and therefore the 
performance of the ^ 

increasing importance. - , 

Consequently, UMTS(rel©as^ 

codes and specifically tlie use of Turbo decodes.. However; these codes are 
complex and the complexity is increased due to the higher order symbols. 
Additionally, the error probability of a given bit is increased due to the 
uncertainty in the decoding process of the value of other bite comprised in 
the higher order symbols. Furthermore, although the conventional 
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implementation of turbo cpdes provides Wghxpe they do not 

attain the fewer theoretical bound for bit error rate^ Alijo; conventional 
turbo coders aBBume tKat the np^e isinde 
which is not the case for multi-level alphabets. 

Additionally, any improvement in the performance of error correcting 
coding and decoding will hot only provide mr an improvement in the 
achieved bit error rate but may also allow for lower transmit powers. For a 
cellular communication system, this may result in reduced interference 
and ultimately in an improved capacity of the communication system. 

Consequently an improvement in performance and/or reduction in 
complexity of an error correcting system would be highly advantageous. 

Summary of the Invention , .;? . : .. 

Accordingly, tbe Invention seeks to mitigate, alleviate or eliminate one or 
more of the above mentioned disadvantages singly or in any combination. 

Accordingly there is provided a decoder apparatus compri8mg^ a melihood 
estimator for generating a sequence of bit value likelihood estimates of a 
sequence of bit values of multi bit symbols of a data sequence! a first 
decoder element for generating a first decoded data sequence in response 
to the bit value likelihood estimates; a weighting processor for generating 
a weighted compensation data sequence in response to the first decoded 
data sequence and reliabUitiee of the data of the first decoded data 
sequence; and wherein the likelihood estimator is operable to modify the 
sequence of bit value likelihood estimates in response to the weighted 
compensation data. 
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The decoder performance is improved by the bit value like] ihood estimates 
being modified from the first decoded data sequence. Specifically, the first 
decoded data sequence may be used to modify the bit value likelihood 
estimates such that decoded bits that are correctly decoded with high 
probability modify the bit value likelihood estimates so as to reflect an 
increased probability for this bit value. In particular the modifying of the 
bit value likelihood estimates may reflect feedback of decisions of the 
decoded data thereby introducing deci sion feedback for the decoder. 
Specifically, the bit value likehhood estimates for a given bit may be 
modified by using the first decoded data sequence to assist in the : - r 

determination of the bit value of other bits of the higher order data 
symbol. The improvement in performance of the decoding process may 
specifically be represented by a reduced data error of the decoded data 
sequence. 

The likelihood estimator may be a separate entity or may be an integral 
part of the first decoder element. As such, the bit value li kelihood 
estimates may be generated independently of the decoding process or may 
be an integral part of the decoding process such as for example associated 
with the derivation of branch metrics for trellis based decoders: 

The performance improvement provides additional advantages of a 
reduced decoded error rate, reduced required transmit power, reduced 
interference and/or increased capacity of the communication system. 

According to a first feature of the invention, the first decoder element is a 
Maximum A Posteriori (MAP) decoder. Tbis decoder is suitable for ^ 
implementation of the decoder apparatus and in combination with the 
previously described features provide very high performance with low bit 
error rates. 
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According to another feature of the invention, the first decoder element is 
a Soft Output Viterbi Algorithm (SOVA) decoder: This -decoder is suitable 
for implementation of the decoder apparatus and in combination with the 
previously described features provide veiry hi gh performance with low bit 

•5 error-rates.- -i ■■>>•;> >f. - ^rr. v.; :.■'■» f r 1 

V -. t • . vcjirrjiVvv^ ■•• / i» .. • 

According to another feature of the invention, the fibrst decoded data 
sequence comprises data values associated with the reliabilities of the 
data of the first decoded data sequence. Advantageously, an efficient 

10 representation of both data values and a measure of the probability of s 
correct decoding decision is comprised in the first decoded data sequence. 
Specifically, a soft decision data value may be used to indicate both data 
value and reliability. -\i ,.»> *v.u- > • '* -^^i >\ m , f • 

15 According to another feature of the invention, the data sequence comprises 
an uncoded information data sequence, a first coded sequence generated 
from encoding of data of the information data sequence arid a second coded 
sequence generated from encoding of interleaved data of the information 
data sequence; arid the first decoder is operable to generate the first 

20 decoded sequence in response to bit value likelihood estimates of the 
information data sequence arid the first coded sequence; the decoder 
apparatus further comprising: an interleaver coupled to the output of the 

first decoder element; a second decoder element coupled to the inter! eaver 

• . ■ 1 / * 

and operable to generate a second decoded data sequence in response to 
25 bit value likelihood estimates of the information sequence arid the second 

coded sequence. Improved performance can be achieved through the use of : 
the second decoder thereby potentially reducing error rates, transmit 
powers, interference and/or increasing the capacity of the communication 
system. - v - ■■ - r - .fyi;-: v;i >\r s » •«.■=■ •-. 

30 

AaK)rding to another feature of the invention the second decoder element 
is a Maximum A Posteriori (MAP) decoder. This decoder is suitable for 
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implementation of the decoder apparatus and in combination with the 
other features provide very high performance with low 3»fc«rqr rates; 

According to another feature of the invmtioh Uie mrand decoder element 
is a Soft Output Viterbi Algorithm (SOVA) decoder. This decoder is 
sui table for implementation of the decoder appai^ta 
with the other feature* provide veiy hti^k performance with low bit error 
rates. i? 

10 According to another feature of the invention, the second decoder is 
operable to further generate the 

to the first decoded data sequence. Hence, the decoded data of the first 
decoder may be used to improve the decoding in the second decoder ? 
thereby further impi^y^^ 
15 decoder. 3 . 

According to another feature, of the 

further comprises a de?int^rleav^r coupled betw^ 

second decoder element and the input of the first decoder element and 

20 wherein the first decoder element is operable to further generate the first 
decoded data sequence in response to the secon sequence: ; - 

Hence, the decoded datavpfethe second dwdei^ ma^be used to improve the 
decoding in the first dewier thereby further improving the decoding 
performance of the first decoder. The first ^ 

25 iteratively interoperato to provide improved overaD decoder performance^ 

According to another fea^e of the invention, ^ apparatus is a 

turbo decoder apparatus. This decoder is highly suitable for the 
implementation of the decoder apparatus an^^ 
30 performance and low bit error rates. 1 
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According to another feature of the invention; the weighty 
operable to generate weighted rampenflati 

sequence in response to the first decoded data sequence and reliabilities of 
the data of the first decoded data sequence. This advantageously allows 
5 the bit value likelihood estimates to be improved specifically for the 
information data in response to the firgt decoded data ^equbnce arid 
possibly in response to only the first decoded dW se^ence. Specifically, 
only the bit value likelihood estimates of the information bits of the data 
sequence may be modified. 

According to anpth» featui^ of the ^ 

operable to genera te weighted compensation data for the first coded data 
sequence in response to the first decoded data eequence and reliabilities of 
the data of the first decoded data sequence. Hence, performance may be 
15 improved from an improvement in the bit value likelihood estimates for 
the first coded sequence. Specifically, the first decoded data sequence may 
comprise data values and reliabilities for the first coded da may 
be used for the modification of the bit value likelihood estimates of in 
particular the bite of the first <»ded^d^ z#t£ r-Ti , * ,v 

According to another feature of the invention, the first decoded data 
sequence comprises deeded & 

sequence. This allows for the* advantage of the information obtained by 
decoding the first coded data to be used in improving the bit value f 
25 likelihood estimates. .< ^ v<^i.> v: ^ 

Accordiiig to another feat^ 

operable to generate weighted ;«mpensatSonvda^ 

sequence in response to the second decoded data sequence and reliabilities 
30 of the data of the second decoded data sequence. This advantageously 
allows the bit value likelihood estimates tt be imp^ 
information data in response to the second decoded data sequence and 
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possibly in response to only the secpnd decoded data sequence. 
Specifically, only the outvalue 1*^9^ 
of the data sequence may be modified 

5 According to anothe^ feature of the inv^n^on^ 

operable to generate weighted compei^tfen date for the second coded 
date 8equence in resDOnse to the seopnd dec date sequence ^d 
reliabihtiea of the date of the second decoded data sequence. Hence, 
performance may be improved from an improvement in the bit value 
10 likelihood estimates for the second ended sequence. Speci&ally^ teeseoond 
decoded date sequence may comprise date values and reliabilities for the 
second coded date and this may be used for the modification of the bit 
value Kkehhoodestim 

date Additionally, weighted compensation date may be generated for the 
IS first coded date sequence in response to the second decoded date sequence 
and reliabilities of the date of the second decoded date sequence 



20 



According to another feature of the invention, the second decoded date 
sequence comprises decoded date corresponding to^^ second coded data 
sequence. This aUows for the advante&r obtained by » 

decoding the second coded date to be used in improving the bit value 
likelihood estimates thereby resulting in improved decoder performance. 

According to another feature of tee invention, the second decoded data 
25 sequence comprises data values associated with the reliabilities of the 
data of the second decoded date S^uence. Advantegeously, an efficient 
representation of both data values and a measure of the probability of 
correct decoding decision is comprised in the second decoded data 
sequence. Specifically, a soft decision data value may be used to indicate 
30 both data value and reliability. 
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According to another feature of the invention, the decoder apparatus is 
operable to iterate the decoding operation. Hence, the improved bit value 
likelihood estimates can be used to provide an improved first decoded data 
sequence. This can be used to provide improved bit value likelihood 
5 estimates, which again can be used to provide an improved Erst decoded 
data sequence etc; In paiiicular, if the decoder apparatus comprises two 
decoders, the decoded data sequence of one decoder can be used in the 
other decoder to imjprove/the decoding jwrfoiroance of ^ processor and 
so on. Hence, a significantly improved performance of the decoder 
10 apparatus may be achieved. ' *""' :j * 1 " v ' * ' ' * 1 

According to another feature of the invention the weighting processor is 
operable to weight each bit of the weighted compensation data in response 
to the likelihood of that bit being a j^Ven 

1 5 modification of the bit value likelihood estimates to be weighted in 

response to the reliability of the decision. Hence, it allows for a decision 
feedback which is in response to a decision probability thereby 
significantly reducing the probability of erroneous or detrimental feed 
back* Preferably, it 1 time allows lor the feedback impact of each bit to be 

20 weighted in accordance with the certainty of the decoding decision. This 
provides for a significantly improved performance, " 

According to another feature of the invention, the likelihood estimator is 
operable to modify a bit value likelihood eeti mate of a bit of the sequence 
25 of bit values in response to the weighted compensation data. Preferably 
each bit may be modified individually in response to the probability of 
correct decoding decision for that bit and/or of the other data bits of the 
corresponding symbol. 

30 According to another feature of the invention, the weighting processor is 
operable to set a value of a bit of the weighted compensation data 
sequence to a hard decision bit value if the reliability of the decoded data 
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corresponding to the bit is above a threshold. This provides for ah efficient 
implementation of the method as the complexity of the feed back is 
reduced. Further, decoder performance may be improved. 

5 According to another feature of the invention, the weighting processor is 
operable to set a value of a bit of the weighted compensation data 
sequence to a nuU value if the reliability of the decoded data corresponding 
to the bit is less than a threshold. Preferably, the Likelihood processor is 
operable not to modify a bit value likelihood estimate for a bit 
JO corresponding to a bit of the weighted compensation value having a null 
value. This reduces the likelihood of erroneous decoding decisions 
impacting the bit value likelihood estimates and thus reduces the 
therewith associated deterioration of performance. Consequently, this 
feature allows for improved performance of the decoder apparatus* 

is ■ ■ 

According to another feature of the invention, the bit value likelihood 
estimates are logarithmic likelihood ratios between the probability of a bit 
having a first value and a second value* This provides for a suitable and 
low complexity implementation of the decoder apparatus yet allowing for 
20 high performance* 

According to a second aspect of the invention, there is provided a method 
of decoding comprising repeating the steps oP generating a sequence of bit 
value likelihood estimates of a sequence of bit values of multi bit symbols 

25 of a data sequence; generating a first decoded data sequence in response to 
the bit value likelihood estimates; generating a weighted compensation 
data sequence in response to the first decoded data sequence and 
reliabilities of the data of the first decoded data sequence! and modifying 
the sequence of bit value likelihood estimates in response to the weighted 

30 compensation data. 
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Brief Description of the Drawings .. 

An embodiment of tie invention will be described, by way of example only, 
with reference to the drawing, in which 

5 . .. * ...... ... 

FIG. 1 is a decoder apparatus in accordance with an embodiment of the 
invention; and ; ^ i • 

FIG. 2 is an illustration of a decoder apparatus having two decoder 
10 elements in accordance with an embodiment of the invention. 



Detailed Description of a Prefer^ 

15 HG. 1 is a decoder apparatus 100 in accordance with an embodiment of 
the invention. .. t ^ 

Hie decoder apparatus 100 comprises a Hkelihood estimator 101 which 
receives a data sequence comprising data to be decoded. The likelihood , 
20 estimator generates bit value likelihood estimates for the bit values of thd 
daita ^quence. Specifically, in the preferred embodiment, the likelihood 
estimator generates a log likelihood ratio representing the relative 
probability of a bit having one of tbe two ppssible 

likelihood estimate Lb ha^doi^ corresponding to the 

25 symbol of th a t bit, _ . 

Thus the bit value likelihood estimate may ^rdetoimin^ 
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wherein LLR represents the log likelihood ratio, pi is the current bit and 
Uk is the received data symbol. 

In the following, the LLR generation of the likelihood estimator 101 ib by 
way of example illustrated for the case of higher order symbols such as a 
Quadrature Amplitude Modulated (QAM) symbols or PhaBe shift Keying 
(PSK) communicated over an Additive White Gaussian Noise (AWGN) 
channel. 

For example, 4 bits are mapped into one 16-QAM symbol, 2 bite, denoted 
by u and ijz, are mapped into real part of a symbol as sr = 2 i 2 + i 2 arid the 
other 2 bite, qi and q*, are mapped into imaging 
= 2 qi + q 2 , where each bit takes a value of 1 or Consequently, one 
symbol can be denoted by s = si + jsQ. 

The received signal in one symbol interval can be written as 

where n is complex white Gaussian noise. The probability density function 
(pdiOofris 

*H 2*o la] 2a\, J 

where or* « <y* = E($$)\ represents the energy of the Gaussian 

noise. The log-likolihood function for si and sq can be expressed ae 

* - • v. . : » . 

The log-likelihood ratio LLR of a bit may consequently determined as 



WO 2004/042989 



Q 

PCT/EP2003/0S0798 



14 



where Si and S-i are sets of (si bq ) corresponding to bv - 1 and -1 
5 respectively, aiid bk repres ents ftny one of bits corre spori ding to a symbol. 

For example, in case of 16QAM- k ; ^ >i • u 

=-3,-1, 1. 3 for 4, (1,1), : 
V =-3,-l, 1, 3 lor ( ai , ft ) = H-^ H>% <V-m 

10 

The log-likelihood function of ii = 1 is picked np among 8 values 4 
determined by {2r^ -5/ + Ursg 5^) corresponding to si > 0* Similarly, the 
log-likelihood function of ii == -1 is the largest one among 8 quantities of 
{2rs, - sj +2rs Q ^s%} evaluated for 8 symbols corresponding to si <= 0. 

The decoder apparatus further comprises a first decoder element 108 for 
generating a first decoded data sequence in response to the bit value 
likelihood estimates. Although the likelihood estimator is shown as 
separate from the first decoder element, it may be an integral part of this 
20 and other decoder elements of the decoder apparatus* Specifically, the 
likelihood estimator may in some embodiments generate bit value 
likelihood estimates used for branch metrics in trellis based decoders. 

In the preferred embodiment, the received data sequence has been 
25 transmitted using a convolutional encoding process, and the first decoder 
element 103 is a Maximum A Priori (MAP) decoder which is operable to 
decode the convolutionally encoded signal based on the derived log 
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likelihood ratios determined by the likelihood estimator 101. Specifically, 
the MAP decoder may be a log MAP or a max log MAP decoder. A log MAP 
decoder is characterised by a eymbol by-Bymbol decoding process in which 
the likelihood of correct symbol decision ia maximised by considering 
products and sums of likelihood ratios expressed in logarithmic unite. The 
max log MAP decoder is characterised by a eymbol-by-symbol decoding 
process in which the likelihood of correct symbol decision is increased by 
considering products and approximations to Bums of likelihood ratios in 
logarithmic units 



Alternatively, the first decoder element is a Soft Output Viterbi Algorithm 
{SOVA) decoder. The SOVA decoder is chwri^^ 

symbol decoding process in which the likelihood of correct symbol decision 
is increased by considering the sums of logarithmic likelihood ratios of a 
15 set of candidate paths through a code-trellis* 

The first decoder element 103 in the preferred embodiment generates a 
decoded data sequence, which not only represents the decoded estimate of 
the bit values but also an indication of the reliability of this estimate. In 

20 the preferred embodiment, the first decoder element 103 generates a soft 
decision output wherein the magnitude of the bit value is indicative of the 
probability of a correct bit value. Specifically, the output of the first 
decoder element 103 generates decoded data values which themselves are 
log likelihood ratios. Hence, the decoded data sequence comprises data 

25 values that are associated with the reliabilities of the data of the decoded 
data sequence. 

The decoder apparatus 100 further comprises a weighting processor 105 
connected to the output of the first decoder element 103 and the likelihood 
30 estimator 101. The weighting processor 105 is operable to generate a 
weighted compensation data sequence in response to the decoded data: 
sequence of the first decoder element 103 as well aa the reliabilities of the 



WO 2<)04/042«>89 



PCT/EP2l)Hi3/05il75)8 



10 



16 

data of the decoded data sequencer Each Wt pf the compensation data 
sequence is in the preferred embodim^ th e reliability 

of the corresponding bit of the decoded data sequence, such that the 
introduced compensation i^m^ 
known with Wgh reliability. 

Specifically, the weighting processor 105 is operable to set a vaJue of a bit 
of the weighted compensation data sequence ^ dedeion bit value if 
the reliability of the decoded data corresponding to the bit is above a 
threshold, and to set a value of a bit of the weighted compensation data 
sequence to a nuU value if the;^ 

to the bit is less than a thresholds Thus, for each bit, the weighting 
processor 105 estimates the reliability of the d^ Wt^y^u^ H the 
reliability is above this thrrahald,^ 
15 compensation data to the hard dedsion decoded bit value. If it is below the 
threshold value, the corresponding bit of the compensation data is set to a 
null v«lue r wMch^^fito 
information related^to 

20 The likehhood/estimator 101 is connected to the weighting processor 105 
and is operable to modify the sequence of bit v^w^^ 
response to the weighted competition 

element 1 03 has generated a decoded sequence on the basis of the bit 
value likelihood estimates,, the decoded data sequence is used to modify 

25: the bit value likelihood estimates in order to improve the derived bit value 
likelihood estimates .The first decoder element 103 eubsequenUy repute 
the decoding process based on the improved bit value likelihood estimates 
thereby generating an improved decoded sequence. This sequence may 
again be used to generate improved bit value Ukelihcwd estimates, and the 

30 process may thus be iterated as many times as required or desired. 

Specifically, the process jtriay be repeated for a predetermined number of 
times or until the decoded data sequence attains a given reliability. 
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In the preferred embodiment, the modification of the bit value likelihood 
estimates comprises using any weighted compensation data bits 
corresponding to hard decisions to nsLzrow the number of constellation 
5 points over which the maximisation is made over. Specifically, if all other 
bits of a specific symbol are set to their cto^ 

by the weighting proctor jQ5, no maximisation is require* in qr^OT to 
derive a log likelihood ratio for higher order symbols, l^s ^duces th^ 
probability of a log likelihood ratio being determined on the basis of 
10 erroneous assumptions about other bit values, and therefore results in 
improved perfp^ 

is not required over all possible constellation pointe. As 
if all other bitva^es of a given sym^ 

decoded date values &e f with hi^i reliability), the l^likelihood ^alm can 
15 be calculated directly. ^ « l f the lor 

likelihood value of /, = 1 is 



■•■i* i *-. ; 



20 Similarly, 



Hence, the log likelihood ratio can directly be calculated as 

In other Embodiments, other and potentially more complex modifications 
may be miide* For example, the derived Bit value likelihood 'Wtito^-^^. 
log likelihood ratio) for a given bit may diredtiy be biased^a t^^r^dt^n 
30 of the decoded bit value for thajt bit. The extent of the bias may be 

determined in response to the ^liability of the decoded bit value, in this 
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case, the weighted compensation data may represent the bias to be applied 
to the bit value likelihood estimates " *■■ 1 ' ' - 5' 

In the following, an example will be described of an embodiment wherein 
5 the decoder apparatus <k>mprisea a turbo decoder/ 1^ of 
conventional turbo decoders can he found in "Comparative Study 6f Tiirlio 
Decoding Technique^: An Chrervie^ 1^ 3:^1 W^e^nnd L. Haiizoi 
IEEE Transactions oh 

2000. ■ ' - : ^V::- ? \**- ! -^ 

FIG. 2 is an illustration of a decoder apparatus 200 having two decoder 

elements 201, 203 in accordance with an embodiment of the invention. 

Similar to the decoder apparatus 100 of FIG. 1, the decoder apparatus 200 

of FIG. 2 comprises a likelihood esti mator 206/a first decoder element 201, 
15 which preferably ib a MAP or SOYA decoder element, and a weighting 

processor 207. Further, the decoder apparatus 200 comprises an 

interleayer 209 coupled to Hie output of the first decoder element 201, and 

a second decoder element 208 coupled to the interleayer 209. The second 

decoder element 203 is operable to generate a second decoded data 
20 sequence in response to bit value likelihood estimates generated by the 

likelihood estimator 205 or the first decoder element 201 and interleaved 

by the inter leaver 200. 

In this embodiment, the received signal comprises data which has been 
25 coded in accordance with a Turbo encoding scheme. Hence, the data. 

sequence comprises an uncoded information data sequence, a first coded 
sequence generated from encoding of data of the information data 
sequence, and a second coded sequence generated from encoding of 
interleaved data of the information data sequence. 

" ;;;■>.*:■;'•- • \ - f "O' - - • * 

30 

In the described embodiment, the first decoder 201 is operable to generate 
the first decoded sequence in response to bit value likelihood estimates of 
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the information data sequence and the first coded sequence. The second 
decoder 203 is operable to generate a second decoded data sequence in 
response to bit value UkeKhppd estim^ and 
the second coded sequence. Preferably, the second decoder can use bit 
5 value likelihood estimates for the information data sequence derived by 
the likelihood estimator 205 or by the first decoder 201 (as the first 
decoded data sequence). Thus, the second decoder 203 is operable to 
generate the second decoded data sequence in response to the first decoded 
data sequence. In this way significantly improved performance of the 
10 decoding can be achieved. ...... 

The decoder apparatus 200 farther <*mpri^ 

between the output of the second decoder element 203 and the input of the 
first decoder element 2pl. The fi^ 
15 capable of generating the first decoded date sequence in response to the ; 
bit value likelihood estimates derived by the hkelihood estimator 207 OS by 
the second decoder element 203 ^ 

The interleave? 209 and deinterleaver 21 1 compensates for the f i 
interleaving of data between the first coded sequence and the second <^ 
20 sequence performed as part of the turbo encoding. 

The s t^cture thus provides for an iterative decoding process wherein 
improved bit value likelihood esti mates are continuously improved by 
decoding, mid these improved bit value likelihood estimates are then used 
25 in another decoding process thereby generating even further improved 
decoded data. 

Similarly* to the decoding apparatus of HG. 1, the we^ 

207 generates weighted compensation data in response to the decoded ...... „ 

30 data. Specially, the weighting processor 207 is operable to weight each 
bit of the weighted compensation data in response to the likelihood of that 
bit being a given value. The weighted compensation data is then used to 
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improve the bit value likelihood estimates thereby improving the decoding 
performance and potentially reducing complexity of the decoding process;. 
Thus the likelihood estimator 205 is operable to modify a bit value 
likelihood estimate of a bit of the sequence of bit valuer in response to the 
5: weighted compensation data. * ' 

. • - - ! , . \. - ' - 

The weighting processor 207 is operable to generate weighted 
compensation data for the information data sequence. This weighted ? 
compensation data may be generated in response to the first decoded data 

10 sequence and reliabilities of the data of the first decoded data sequence. 
Alternatively or additionally, it may be generated in response to the 
second decoded data eec^enciei and WliabiK^ of ^e seomd 

decoded data sequence. In the described embodiment, the first and second 
decoded data sequences comprise the decoded iiiformation data sequence. 

15 However, preferably the first and second decoded data sequence ' 

additionally comprise the decoded data corresponding to the first coded 
data sequence and the decoded data corresponding to the second coded 
data sequence respectively. Hence, the first and second coded data 
sequences are not only used as auxiliary data values for the decoding 

20 process of the first and second decoder elements, but are themselves 

decoded and used in the generation of the weighted compensation data. 

Furthermore, the weighting processor 207 is preferably in the described 
embodiment operable to generate weighted compensation data not only for 
25 the information data sequence but also for the first coded data sequence in 
response to the first decoded data sequence and reliabilities of the data of 
the first decoded data sequence, and for the second coded data sequence in 
response to the second decoded data sequence and reliabilities of the data 
of the second decoded daM sequence. v 

Hence, in accordance with different embodiments, decoded data from the 
first decoder element 201 or the second decoder element 203 or both may 
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be used to generate the weighted compensation data. Furthermore, for 
each of these decoder elements 201, 203 the decoded information eequence 
or the decoded data of the coded data sequence or of both may be used to 
generate the weighted compensation data. However, preferably all 
5 decoded data from both decoder elements 201, 203 are used in order to 
optimise decoding performance. 

Further, the weighted compensation data may be used to modify the 
information data of the received data sequence, the first coded data 
1 0 sequence of the receive d data sequence and/or the second coded data 
sequence of the received data. However, preferably, the weighted 
compensation data is applied to all of the data of the received data 
sequence. 

15 In the following, an embodiment of the decoder apparatus of MG, 2, wWqh ; 
id particularly suitable for 3 rd Generation communication systems, such as 
UMTS, will be described in more detail. 

For the UMTS communication system, a turbo encoding scheme has been 
20 specified for some scenarios and services. A turbo encoder for this purpose 
comprises a parallel concatenation of two recursive systematic 
involutional (RSG) encoders with an in terleaver between them. The 
output of the turbo encoder is formed by multiplexing the information bits 
b*= {fr,,fci,-s!» w } , the first and second coded data sequence known as parity 
25 bite p, *{piuPn r ",Pi N ] and p 2 « {p a i*Pair*-»Pi*}> (For notational convenience, 
the tail bits of each frame are ignored) A turbo decoder basically consists 
of two constituent decoders, such as the first and second decoder elements 
201, 203 of FIG. 2, corresponding to the two RSC encoders in the 
transmitter. The received samples, denoted by y k , are de- multiplexed into 
30 and jtV^ representing samples for systematic bit fa, parity bits pi* 

arid pzx respectively. The decoder elements in this e mbo di ment are MAP 
decoder elements, which minimize the probability of error for an 
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5 



information bit given the received sequence, and aJeo provide the 
probability that the information bitie either ! or 0 given the received 
sequence. During the discoding procedure of each of the decoder elements^ 
the Log Likelihood Ratio CLLR) for each information bit is calculated as 



10 where ya0j,m), called the branch metric, represents the traneition ' 
Hkelihoodfrom state n at time *-/ to state m at iim^ 
received samples u k . here «,» denotes a pair of > flt-Xin) is likehhood 
of being instate mat time A-J with the received sequence {u^u^u and 
denotes likehh^ 

15 from state m at time 'The qua^ 

of «*-i(m) and Yifand and is calculated by a forward recursion 



■«=«' 

where Mis the number of Btalesj Reverse recursion for 

computing the quantity ACq) fiom and j^nst) is 



25 A(»)=£^i0»)r*(».»»> wb.o^M-i 

«4 • •:» i- "■••< ••• >• " -•• • 

The numerator of LLR'of bt ip computed by summing over a set -5* which 
denotes that all transitions correspond to &t =l Similarly, the 
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denominator of LLR of A* is calculated over a set BP where all transitions 
give bk equals 0. 

Hence; the LLR for each bit is determined by a summation over all 
5 possible state transitions corresponding to the r specific bit value of the 
product of the probability of being in the previous state given the 
previously received samples, the probability of a transition ftpm the . 
previous state to the next state given the current received sample, and the 
probability of receiving the future received samples from being in the next 
10 state. 

In practice, the true LLR of a bit cannot be guaranteed because the true 
values of other bits in a channel symbol are not known for sure. 
Accordingly, in the current embodiment decision feedback, which is 
15 obtained in a simple way from the turbo decoder recursions, is used in 
order to improve the estimate of the LLR compared to the conventional 
method* 

Clearly, if the LLR is calculated based on erroneous feedback bite, overall 
20 performance could be worse than that of conventional turbo decoder; 
Fortunately, in turbo decoding, the reliability associated with each 
estimated bit is known. Therefore the described embodiment utilises 
partial decision feedback based on the soft decision (LLR output) of one or 
both of the decoder elements. That is, only those hard decision bits with 
25 high reliability are Used to refine the LLR calculation. The feedback bits 
are determined as 

LLR{b k )Z T 
LLR(b k )<-T 
Otherwise 



1 

-1 
0 
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where T 10 a preset threshold. Ay == 0- means this bit is unknown. 

Maximization in LLR determination should be performed over all possible 
combinations associated with this bit. For example, in 16QAM case, one 
unknown bit requires maximization over two channel symbol b; two 
5 unknown bits requires determination of the largest V4alue among 4 points 
in the signal constellation; and 3 unknown bite degenerate to a 
conventional LLR calculation procedure/Simulation results indicate that 
the partial decision feedback is critical in performance improvement. 

10 It is well known that the conventional turbo decoder only calculates 

information bits. However, improved performance can be achieved with 
using partial decision feedback for all code bits including both information 



15 The parity bits could be regenerated byre-encoding of the decoded 
information bite. However, this may introduce additional delay which 
could make partial decision feedback impractical. It may also result in 
high bit error rate because of infinite impulse response of the recursive 
convolutional encoders , which are constituent encoders of turbo codes, For 

20 instance, one error in the decoded information bit may cause multiple 
errors in re-encoded bits. TCerefbro/^ 

decoder is modified such that all parity bits are recovered with negligible 
computation. "" *'* "■-'-■■^ 4 ** " *•'■■'>.■ 

25 In addition to calculating the LLRs for information bite, the modified 

turbo decoder in accordance with the described embodiment computes the 
LLRs for parity bits. Accdrdirig to the MAP criterion, the LLR of a parity 
bit given the received samples ■'»« {u^„u N } can be written as 



30 LLR(J> t ) - h ,^='l«») =ln PO>,=1» 
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where p(J denotes probability. Following the same procedure as that for 
information bits, this gives 



turbo decoding, major computation and memory are utilized for 
determining y^jj f m> f on(/n) and Bdjn). Once they are available for the 
information bits, only relatively minor computation is required to 



addition is replaced by max* which is defined as max*(a, b) = roax(a, b) >■ 
ln(l«fexpMa-b|)X 

Simulations have been performed by the applicant to illustrate an 
example of a possible advantage thai may be achieved. This specific 
simulation related to a turbo decoder with partial decision feedback for 
16QAM modulation over AWGN channel. The 3GPP turbo code 
specification with a constraint length K=4 and code rate 1/3 was used. The 
code block length was 6000 information hits. 12 iterations were used in 
turbo decoding, A threshold of 2 was used to determine hard decision 
feedback bits. The simulations showed that for this specific example a 
performance gain of more than 0.5 dB was achieved. 

The invention can be implemented in any suitable form including 
hardware, software* firmware or any combination of these. However, 
preferably, the invention is implemented as computer software running on 
one or more data processors and/or digital signal processors. The elements 
and components of an embodiment of the invention may be physically, 
functionally and logically implemented in any suitable way. Indeed the 
functionality may be implemented in a single unit, in a plurality of units 
or as part of other functional units. As such, the invention may be 



LLR{p k y=\fi 




where P 2 and P° have a similar meaning of B 1 and BP respectively. In 



determine the LLR of the parity bits. In the log-MAP algorithm, every 
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implemented in a single unit or may be physically and ftmctipnally 
distributed between different units and processors. 

Although the present invention has been described in connection with the 
5 preferred embodiment, it is not intended tobe limited to tHe Bpecific form 
set forth herein. Rather, fee scope of the present invention is limited only 
by the accompanying claims. 



